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(57) Abstract 

The present invention refers to an Internet caching system and to an arrangement and a method for serving request for Internet 
information files in an Internet caching system. The system is built as a two tier caching system. In order to decrease, the load on a central 
cache server (130), an intermediate arrangement (110) interconnects the local servers (100) of the system to the central cache server (130). 
This arrangement communicates with the local cache servers in accordance with a protocol used for communicating between cache servers. 
When requesting an Internet information file from the central cache server, the arrangement uses the Structured Query Language. Thus, the 
central cache seiner (130) is primarily devoted to answer plain SQL queries. 
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AN INTERNET CACHING SYSTEM AND A METHOD AND AN 
ARRANGEMENT IN SUCH A SYSTEM 



Technical field of the invention 

The present invention refers to an Internet caching 
system and to an arrangement and a method for serving 
requests for Internet information files in an Internet 
caching system. 

Background art 

The Internet and its currently most used feature, 
the World Wide Web (WWW) , has in recent years developed 
into an enormous source of information. Anybody can pro- 
vide any information, such as text, pictures, audio and 
video, on the World Wide Web where it can be easily 
retrieved by users anywhere in the world as long as they 
15 have access to the Internet. 

The major problem facing the Internet is the growing 
demand for communication capacity as users access infor- 
mation from anywhere in the world. It is estimated that 
the World Wide Web traffic already exceeds all conven- 
tional telephone and facsimile traffic on most inter- 
national communication lines. More transmission and 
switching capacity is continuously added, but it is a 
slow and expensive process and demand continues to 
outstrip supply. 

The content of the World Wide Web is getting to be 
unmeasurable and probably comprises several hundreds^ of 
Terabytes (as of summer 1998). However, a relatively 
small subset of all this information accounts for a huge 
portion of the information actually being accessed. 
Therefore, in order to minimize bandwidth used and 
latency involved when accessing information on the 
Internet, different caching techniques are currently in 
use for limiting the amount of information that has to be 
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transferred over the Internet and for limiting the 
distance over which the information is transferred. 

In the field of caching WWW objects, or Internet 
information files, there are basically two approaches, 
5 client side caching and server side caching. The simplest 
form of client side caching is virtually used by every 
WWW browser today. The browser retains a cache on the 
user's computer with the last accessed Internet informa- 
tion files. When the user for a second time wishes to 

10 access a particular information file, the browser 

retrieves it from its cache rather than making a request 
for it over the Internet. 

In order to help a neighboring user, a proxy server 
caching method, another form of client side / caching, can 

15 be used. In this scheme a cache is placed at a WWW proxy 
node to which a number of neighboring users are con- 
nected, such a proxy node could for example be a server 
located at a company. When a WWW client wants to access a 
WWW server on the Internet, the client sends a http 

20 request to the proxy node, or WWW proxy server, rather 
than sending it directly to a server on the global 
Internet. Instead it is the proxy server that sends the 
request to a WWW server on the -global Internet, caches 
the response and returns the response to the client. 

25 Thus, the first time an information file is requested it 
is transferred over the Internet and stored in the cache 
of the WWW proxy server. Subsequent requests for the same 
information file from any client connected to the WWW 
proxy server can then be resolved locally, rather than 

30 making http requests to a WWW server over the global 

Internet. Proxy server caching can also be used outside 
the premises of a company, or some other organization, by 
implementing the scheme described above at a regional 
Internet cache server to which a number of clients are 

35 directly or indirectly connected. 

Depending on the size and homogeneity of a user 
community using a cache at a server, about 20-40 Giga- 
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bytes of cache storage will (spring 1998) reduce the 
Internet traffic generated by the user community by 30-50 
%. As the growth of the information provided by the 
Internet and the WWW continues, it is highly likely that 
the required cache size will have to increase over time, 
to retain the hit rate, i.e. the proportion of the infor- 
mation files requested that are transferred from the 
cache server. Furthermore, it would give significant 
benefit for the performance and utilization of the 
Internet if the hit rate could be increased to 75% or 
more. With the typical end user behavior, this would 
require a much larger cache, currently in the order of 
200-400 Gigabytes, but also .require very many members in 
the end user community, currently several hundreds of 
15 thousands. The reason is that the larger the end user 

community, the larger the probability that someone else 
within the community has previously accessed a requested 
file, especially if the users share some common interest. 

Installing a large cache is easily achieved by 
acquiring the appropriate computer and the appropriate 
disk capacity. However, it is also required that the 
cache is able to handle all requests from the partici- 
pating end users. Using current technology, it is not 
possible for one single processor computer to serve the 
requests from several hundred thousand end users. Hence, 
several systems have been presented to deal with this 
problem, here outlined under the names of their major 
proponents. 

Cisco Systems, Inc. proposes that the end users are 
connected to a backbone router which is programmed to 
transparently redirect all WWW requests to a group, or 
"Farm" of dedicated cache appliances, or "Cache Engines". 
Each Cache Engine handles a subset of all origin WWW 
servers, based on grouping of the IP (Internet Protocol) 
35 addresses. The solution scales up to 32 Cache Engines in 
parallel, which corresponds to serving approximately 
500.000 subscribing end users. 



20 



25 



30 



BNSDOCID: <WO 0017765A1J_> 



I 

WO 00/17765 PCT/US99/21248 

4 

Inktomi Corporation suggests that a switch, a so 
called layer 4 switch, is used to redirect all requests 
for WWW pages to an "Inktomi Traffic server". A cluster 
of powerful computers are used, which all share the same 
5 disk storage system. This solution scales up to 16 

parallel workstations, which also corresponds to about 
500.000 subscribing end users. However, having several * 
computers accessing the same disk storage system adds 
complexity and requires management, i.e. some of the 
10 capacity of each computer is not available for processing 
requests . 

Network Appliance, Inc. proposes a two tier caching 
solution. The system has several local caches near the 
end users. These local caches communicate with a central 

15 cache using the Internet Cache Protocol (ICP) when a 

cache miss occurs at the local level. If the requested 
file is present in the central cache, it will be trans- 
ferred to the local cache and then forwarded to the end 
user. If the requested file is not in the central cache 

20 either, the central cache will make a request to the 
origin server and forward the file to the local cache, 
which in turn forwards the file to the end user. The 
central cache thus handles ICP requests from the local 
caches and communicates with the origin server in the 

25 case of a cache miss at the central cache. For scale- 
ability, there can be several central caches in parallel, 
each handling a subset of the origin servers. This means 
that the local caches are able to .address each request to 
the correct central cache server. Since this protocol is 

30 . not standardized, it means that all local caches have to 
be delivered from Network Appliance, Inc. 

All of these solutions have the drawback that a 
central cache server needs to handle extensive communi- 
cation in one way or another. This results in low utili- 

35 zation of the server's capacity and- difficulties in 

serving hundreds of thousands users, which is required in 
order to obtain a high hit rate. By adding more servers, 
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Summary of the inv.nH m 

An object of the present invention is to overcome 
the drawbacks with the presently known technics for 

10 a sol"!- 1 r" i0n f " eS °" the Int " net — to PrZ ide 

IZ T " Chin9 lnf °-*"on "les in a cost- 

effective way. 

vide f 0t ?"° bject of present invention is to pro- 
bation AT f " h °" USer ' S re " Ue " s *« ^or- 
is fast h *™ t0 ^ S8rVed by 3 cachi »* system i n a 
15 fast and cost-effective way. 

.„i a r th6r ° bjeCt iS t0 provide a «eh. server 

solution wh.cn is able to cope with the g ro„in g nosers 

tLtr:::: „ f : b es bein9 — - «- 

20 oh, • Y ' t an ° ther iS t0 PrOVide a solution for 

!"7 9 ; W « h hit r«e Percentage for information file 
requests directed to a caching system with a minimum of 

Yet another, object of the present invention is to 

m — — — =-abi:°in 

™, K- The ab ° Ve ° b3eCtS a " achi eved by an Internet 
caching system and a method for saving requests for 

0 £ t * r ^ t "les in an Internet caching system 
ln accordanc e with the appended claims. 

According to a first aspect of the invention, there 
x. proved a method for serving requests for Internet 
-formation files in an mternet caching system, IZt 
method comprisina the _<= . . 

1 t,,- . Ps of "living, at a local 
internet cache server, a user request from a user for an 
internet information file; in response to the ^J^i 
request, making a query for said information file If 
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said information file has not been cached by said local 
server; in response to a reply to said query, making a 
file request for said information file, wherein said file 
request is directed to a feeder means if said reply 
5 indicates that a central file server, storing cached - 
Internet information files, has said information file 
cached; and querying, from said feeder means in response 
to said file request, said central file server for said 
information file, in order to decrease the load on said 

10 central file server. 

According to a second aspect, there is provided an 
arrangement in an Internet caching system, said system 
comprising at least one local cache server and at least 
one central file server, both of which servers stores 

15 cached Internet information files, which arrangement, for 
decreasing the load on said central file server, includes 
a Feeder communicating with said local cache server and 
with said central file server, wherein said Feeder 
includes first means for receiving a request for an 
, 20 Internet information file from said local cache server; 

second means for deriving a query from an alphanumerical 
string received from said local cache server; and third 
means for querying said central file server for said 
Internet information file using said query derived by 

25 said second means. 

According to a third aspect, there is provided an 
Internet caching system, which system comprises a set of 
local Internet cache servers, wherein each local cache 
server is arranged to receive requests from users for 

30 Internet information files ;_at least one central file 
server included in a central cache site and storing 
cached Internet information files; and feeder means 
interconnecting said set of local cache servers with said 
central file server, said feeder means including at least 

35 one Feeder, which Feeder comprises means for communi- 
cating with at least one local cache server in accordance 
with a protocol used for communicating between Internet 
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cache servers and means for retrieving Internet informa- 
tion files from said central file server using data base 
queries, thereby decreasing the load on said central file 
server. 

5 The invention is based upon the idea of connecting- a 

number of dedicated computers to a central file server, 
or central cache server, storing Internet information 
files. Relative to the central cache server, these addi- 
tional computers are low end computers. The dedicated 

10 computers are arranged to decrease the load on the 

central cache server by performing some of the tasks 
normally handled by the central, cache server itself. In 
this way the central cache server is able to serve the 
local cache servers connected to the central server, or 

15 rather connected to the central server via the dedicated 
computers, in a fast and cost-effective way. Maximum use 
is made of the expensive hardware forming the actual 
central file server and its file repository in which the 
files are cached, while specialized inexpensive machines 

20 around the file server perform time consuming and time 
critical tasks in parallel. 

Thus, the inventive feeder means, or Feeders, are 
realized by machines being separate from any machine 
realizing a central file server. This will decrease the 

25 load on the central file server, which then is able to 

dedicate more processing time to the actual retrieval of 
cached information files. Hence, the central file server 
is able to serve a large community, of users in an 
efficient way. Since user requests, via requesting local 

30 cache servers, are served more effectively, the number 
of user requests served can be increased, which in turn 
enables the central file server to obtain a higher hit 
rate percentage for its cache. 

According to an embodiment of the present invention, 

35 the feeder means communicates • with the local cache 

servers, on behalf of the central file server, in accor- 
dance with a protocol used for communicating between 
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Internet cache servers. The currently used protocol is 
either the Internet Cache Protocol (ICP) or the Cache 
Digest, but could be any other conventional or future 
protocol used for the same purpose. Thus, by placing the 

. 5 task of accepting, and replying to, queries and/or 

requests for information files in machines being separate 
from the central file server machine, the load on the 
central file server is decreased considerably. 

When a local cache server receives a request from a 

10 user for an information file, which file has not been 

cached at the local server, the local server starts with 
making a query for that file. In one embodiment the query 
is directed to a table, or data base, being internal to, 
or directly connected to, the local server. If said table 

15 indicates that the queried file is cached by the central 
file server, the local server will request the file from 
the feeder means, or Feeder. This querying and requesting 
is then preferably performed in accordance with the Cache 
Digest protocol. However, as with the request from the 

20 user to the local server, the request from the local 

server to the Feeder may be in accordance with any layer 
three protocol, for example an HTTP request. 

In another embodiment, the query from the local 
server is directed to the Feeder. Included in the query, 

25 for example an ICP query, is the URL of the queried 

information file. The Feeder derives a query number from 
the alphanumerical URL of the received query for an 
information file, which query number then is used by the 
Feeder for querying the central file server for the 

30 information file. The Feeder queries the file server for 
information files using a standard SQL query (Structured 
Query Language). If the queried file is present at the 
central file server, i.e. if there is a cache hit, the 
queried file is transferred from the central server, via 

35 the Feeder, to the local server. To have the central file 
server initiate a file transfer as an answer to a SQL 
query, rather than as an answer to a query, such as an 
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ICP query, from the local cache server, means consider- 
able capacity savings at the central file server. 

Alternatively, the query number is derived from said 
alphanumerical URL and from a part of a header informa- 
tion included in said query. This part of the header _ 
information contains specific user information of the 
original requester, for example, the language he is 
using, enabling the central file server to respond in 
accordance with this specific information. The query 
number corresponding to an information file is derived by 
using any hash algorithm, preferably using an MD5 hash 

* l9 ° rl lXe embodiment where the local server ma.es an 
internal query for the information file, the Feeder 
derives the query number from the following request 
directed to the Feeder^ ^ ^ ^ts 
numerical string used for deriving the que y 
the string included in said request, for ™ 
of an HTTP request. The query number is then used by 
Feeder when querying the central file server for the 
Information file, preferably using an SQL query Again, 
it is advantageous to also include at least part o an 
header information field of said request as the basis 

deriving said query number. ,#<■,„ 
in order to decrease the load on the central file 
server even further, the Feeder preferably «»» " 
table storing information relating to each -formation 
file being cached by the central file server. ™* 
for example, being a memory resident MDS indexed hash 
tor exeuuyo. , c^^o-r ran conclude 
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30 table. By searching said table, the Feeder ^ 

whether or not a queried information file y 
the central file server, without hav.ng to query the 
server, and, hence, a faster reply may be given by the 
Feeder to the query from a local server. 
^ According to another embodiment of the present 

35 invention, the Internet caching system further comprises 
updater means, or an Updater, for updating the set of 



WO 00/17765 



PCT/US99/21248 



10 

information files being cached by the central file 
server. The updating procedure consists of transferring a 
copy of a file cached at a local server to the central 
server. The transferred file is a file which, as a con- 
5 sequence of a cache miss at the central server when 

querying for the file, has been retrieved from its origin 
server by the local server and then been cached by the 
same . 

Thus, the central file server, or central cache 

10 server, does not itself retrieve a non-cached file and is 
therefore not burden with having to make a request to an 
origin server for a file because of a cache miss when 
serving a local cache server. Instead, when the Feeder 
evaluates a query from the local cache server for an 

15 information file, and concludes that the queried file is 
not cached at the central file server, the Feeder directs 
a reply to the querying local server, indicating that the 
file is not available, and then orders the Updater to 
update the central file server. Upon reception' of the 

20 reply, which thus indicates a cache miss, the local cache 
server retrieves the file in question from its origin 
server. Upon reception of the order to update the central 
file server, the Updater requests a copy of the file from 
the local server and transfers the thereby received file 

25 copy to the central cache server where it is stored. The 
transferring and storing procedure is preferably per- 
formed at a time when the overall load on the central 
file server is low, and when the local server has been 
given enough time to retrieve the file from its origin 

30 server. 

However, should the local server be located behind a 
firewall, the Updater will request a copy of the file 
from its origin server, which copy then is stored in the 
central cache server. In this case, it is preferred that 
35 the Feeder does not order the Updater to commence the 
updating procedure until after a certain number of 
queries for the same particular information file have 
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been received, where these queries originate from local 
servers being located behind firewalls. Preferably, the 
Updater is realized by a machine being separate from the 
machines realizing the Feeders, as well as being separate 
5 from any file server machine. This is an advantage since_ 
file requests, for example HTTP requests, to origin 
servers may take unpredictable amounts of time and thus 
lead to an unpredictable load on the machine performing 
the requests. However, in a simplified system it is 
10 possible to realize the Updater in the same machines as 
those which realize the Feeders, while still being 
separate from any central file server machine. In an 
embodiment where the machines implementing the Updater 
and the Feeders interconnects the local cache server with 
15 the central file server, without the machines themselves 
being included in the central cache site together with 
the central file server, the separation of these machines 
from the central file server machine is evident. 

Certain Internet information files are not suitable 
20 for caching. Such files are sometimes called dynamic 

information files, the term dynamic comes from that these 
files are continuously updated at the origin server, 
examples of such files are files with stock quotes, 
weather reports and so on. One preferred way of treating 
25 the existence of dynamic files is to uphold a list of 
known uncachable files in either the Updater or in the 
local servers. In this way the communication in the 
system, as a result of a user requesting such a file, can 
be minimized. 

30 According to yet another embodiment of the present 

invention, several central file servers are included in a 
central cache site, each file server caching information 
files associated with original host names, IP-addresses 
or derived query numbers, within a defined range. Based 

35 upon either the original host name, IP-address or the 

derived query number of a requested information file, the 
Feeder addresses the query to the file server caching 
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files in the appropriate range. In this scaleable solu- 
tion each file server has its own disk system, thus mini- 
mizing overhead. Furthermore, the central cache site is 
scaleable with third party file servers because of the 
5 standardized protocols used by the site. 

In order for the communication between the central 
file server and the low end computers, i.e. the Feeders 
and the Updaters, to be fast, each low end computer is 
preferably connected to the central file server by means 

10 of a dedicated wire, alternatively, if there are several 
file servers, by means of a dedicated network. This net- 
work is either a private or a public network. In the 
latter case, at least part of the network capacity is 
preferably reserved for the communication in question. 

15 The network used can, of course, also be a part of the 
Internet, also in a non-dedicated way. The type of con- 
nection used between the central file server and the low 
end computers is very much dependent upon where the low 
end computers, or Feeders and Updaters, are located, at 

20 the same site as the central file server, or, at a loca- 
tion being different from the location of the central 
file server. 

Moreover, it is preferred that the central cache 
site serves a defined set of local cache servers, which 

25 set in turn serves a linguistically and culturally homo- 
genous user community. This will further increase the hit 
rate percentage at the central cache level since it is 
more likely that the same information files are requested 
more than once. 

30 Using the present invention, an operator of an 

Internet caching system, handling information file 
requests in accordance with the present invention, is 
able to provide a fast, cheap and effective way of 
serving a large number of subscribing customers. These 

35 customers preferably being different Internet service 

providers, companies or other organizations connected to 
the inventive central cache site, or inventive Feeders/ 
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Updaters, with their own local cache servers, or, being 
connected as clients to a system encompassing the whole 
inventive caching system formed by the central cache 
site, including Feeders and an Updater, and its connected 
local cache servers. Of course, a customer may very well_ 
also be a single user constituting a single WWW client 
connected directly to the inventive system. Also, a large 
company or Internet service provider can choose to 
operate the inventive system on its own rather than being 
connected to such a system being operated by another 
party. Furthermore, since the inventive caching system is 
built around standardized protocols, such as ICP and SQL, 
local cache servers and central file servers from any 
manufacturer can be included in the system as long as 
15 these protocols are supported. 

Within the scope of the present invention a local 
Internet cache server is to be interpreted as a proxy 
node, preferably a WWW proxy node, retaining a cache for 
the users, or WWW clients, connected to the proxy node. 

Items cached on a local Internet cache server or a 
file server at a central cache site are any non-dynamic 
files which are accessible using the Internet and con- 
taining any type of information. Thus, a number of 
different type of files and different namings of such 
files are included by the term Internet information file 
used in the present invention, such as binary, text, 
picture, audio and video files, HTTP (HyperText Transfer 
Protocol) files, WWW files, FTP (File Transfer Protocol) 
files, WWW pages, WWW objects, and so on. Besides files 
30 being accessed using the HTTP or FTP protocol, any file 
being accessed over the Internet in accordance with any 
layer 3 protocol is also included by the term Internet 
information file. A further example of a protocol that 
can be used is the WTP protocol (Wireless Transport 
35 Protocol) used within the WAP (Wireless Application 
Protocol) standard. 
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. According to a fourth aspect of the present inven- 
tion, the invention encompasses a computer-readable 
medium, on which is stored one or several computer pro- 
grams of instructions for one or several general purpose 
5 computers, comprising means for enabling said one or said 
several computers to perform the steps disclosed in the 
appended claims 1-17. 

According to a fifth aspect of the present inven- 
tion, the invention encompasses one or several program 
10 storage devices containing one or several sequences of 
instructions, for one or several general purpose com- 
puters, for performing the steps disclosed in the 
appended claims 1-17. 

The above mentioned and further aspects and features 
15 of, as well as advantages with, the present invention, 

will be more fully understood from the following descrip- 
tion, with reference to the accompanying drawings, of 
exemplifying embodiments thereof. 

20 Brief description of the drawings 

Exemplifying embodiments of the invention will now 
be described below with reference to the accompanying 
drawings, in which: 

Fig. 1 schematically shows an embodiment of an 
25 Internet caching system according to the present inven- 
tion; 

Fig. 2 schematically s-hows another embodiment of an 
Internet caching system according to the present inven- 
tion; 

30 Fig. 3 schematically shows a flow chart of the 

operations performed by a local cache server in Fig. 2; 

Fig. 4 schematically shows a flow chart of the 
operations performed by a Feeder in Fig. 2; 

Fig. 5 schematically shows a flow chart of the 
35 operations performed by an Updater in Fig. 2; and 
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Fig. 6 schematically shows yet another embodiment of 
an internet caching system according to the present 
invention . 

Detailed description of preferred embodiments 

With reference to the block diagram shown in Fig. 1, 
an embodiment of the present invention will be described. 
In Fig. 1 a number of local cache servers 100 are shown. 
These local servers 100 are, via the Internet, connected 
to feeder means 110, here exemplified with a Feeder 110. 
The number of Feeders 110 and the number of local cache 
servers 100 indicated in Fig. 1 is merely an example, and 
the embodiment is not restricted to these numbers. 

However, regardless of the number of Feeders, each 
15 Feeder is in this embodiment connected to one single 

central file server. In Fig. 1 Feeder 110 is connected to 
a central file server 130. This central file server 
includes a storage medium (not shown) on which Internet 
information files are stored, i.e. cached, and is imple- 
20 mented by a high end computer, such as a Sun Ultra Sparc 
or DEC Alpha Computer. Each Feeder 110 on the other hand 
is implemented by a low end computer, such as a conven- 
tional Personal Computer, and constitutes a front end 
machine which handles the communication between the local 
25 cache servers 100 and the central file server 130. 

The Feeder 110 communicates with the local cache 
servers 100 using the Internet Cache protocol, which is a 
message based protocol used for communicating between 
cache servers over the Internet. Hence, the Feeder 110 
replies to an ICP query for a cached Internet information 
file, the query being received from one of the local 
cache servers 100, with an ICP reply. This ICP reply 
indicates either a cache hit (ICP_0P_HIT) or a cache miss 
(ICP_OP_MISS) . 

35 In accordance with the Internet Cache Protocol, the 

ICP query received by the Feeder includes the URL of the 
queried information file. From this URL the Feeder 110 
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derives a query number, corresponding to the queried 
information file, using an MD5 hash algorithm. Using the 
query number, a memory resident MD5 indexed hash table 
115 is then searched. Included in the Feeder 110 is a RAM 
5 (Random Access Memory) 116 in which the indexed table irs 
stored. The indexed table 115 comprises an entry for each 
query number corresponding to an Internet information 
file cached at the central file server 130. Searching the 
indexed table 115 comprises searching the entries for a 

10 query number matching the derived query number. If a 

matching query number is found in the table, this is an 
indication that the queried information file is cached by 
the central file server 130, and, as a consequence, the 
ICP rely to the local server 100 will indicate a cache 

15 hit. Correspondingly, if a matching query number is not 
found in the table 115, this indicates that the queried 
information file is not cached by the central file server 
130, and, as a consequence, the ICP reply will indicate a 
cache miss. 

20 The means for deriving the query number using the 

MD5 hash algorithm and for searching the indexed table is 
a microprocessor 120, together with an appropriate soft- 
ware module, included in the Feeder 110. The micropro- 
cessor executes the software module, which execution 

25 results in derived query number and in a search of the 
indexed table 115. The implementation of this software 
module is straight forward for a person skilled in the 
art of programming. 

If the reply from the Feeder 110 to the local server 

30 100 indicates a cache hit, the local server will request 
the information file from the Feeder using the HyperText 
Transfer Protocol, which is a protocol used for accessing 
WWW objects over the Internet. That is, an HTTP request 
is transmitted to the Feeder, which request includes the 

35 URL of the requested file. 

When communicating with the central file server 130, 
the Feeder 110 uses common SQL queries. Upon reception of 
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the HTTP request, the Feeder will retrieve the query 
number which was previously derived from the URL of the 
corresponding ICP query. Alternatively, the URL of the 
HTTP request is used for once again deriving the query 
5 number. The Feeder then uses the query number in a " 
standard SQL query directed to the central file server. 
As a response, the central file server 130 will transfer 
the information file in question to the Feeder 110, which 
in turn transfers the information file to the local 

10 server 100 that issued the request for the file. 

If the reply from the Feeder 110 to the local server 
100 indicates a cache miss, the local server will make an 
HTTP request to the origin server (not shown) of the 
requested file, cache the then received file and transfer 

15 a copy of the file to the requesting user (not shown) . 

The means for implementing the execution of the 
Internet Cache Protocol in the Feeder 110 is the micro- 
processor 120 included in the Feeder. The microprocessor 
also implements the means for receiving an HTTP request 

20 from the local server 100 as well as the means for 

querying the central file server 130 using the SQL. The 
operations to be performed by the microprocessor are 
controlled by appropriate software modules, being part of 
the abovementioned means. The implementation of these 

25 software modules would be well known for a person skilled 
in the art of programming and being familiar with the 
protocols in question. 

Another embodiment of an Internet caching system 
according to the invention is described with reference to 

30 Fig. 2. The system in Fig. 2 differs from the one shown 
in Fig. 1 in that the Internet caching system comprises 
an Updater 240, i.e. updater means, being connected to 
the central file server 230, the Feeder 210 and, via the 
Internet, the local cache servers 200. Thus, Fig. 2 

35 illustrates the inventive arrangement encompassing an 
Updater 240 as well as a Feeder 210. 
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Besides what is being described below regarding the 
elements in Fig. 2, the elements of Fig. 2, having corre- 
sponding elements in Fig. 1, operate and interact in 
accordance with what has previously been described with 
5 reference to Fig. 1. Therefore, only the features of _ 
these elements being of relevance to the embodiment 
illustrated by Fig. 2 are described below. 

The Updater 24 0 is responsible for updating the 
storage medium (not shown) associated with the central 

10 file server 230 with new cached information files. As 

described with reference to Fig. 1, when the local server 
200 receives a cache miss in an ICP reply from the Feeder 
210, as a response to a previous ICP query to the same, 
the local server 200 makes an HTTP request for the file 

15 to its origin server (not shown) . The requested file is 

then received and cached by the local server 200. After a 
predetermined time, as a consequence to the reported 
cache miss in the ICP reply, the Feeder 210 will instruct 
the Updater 240 to update the central file server. 

20 The Updater 240 receives, from the Feeder 210, the 

URL of the queried file and the identity of the local 
server 200 which queried for the file. An HTTP request 
for the file is then made from the Updater to the 
specific local server. Upon reception of the requested 

25 file, the Updater stores, i.e. caches, the file at the 
central file server 230. When the file has been stored, 
the Updater instructs the Feeder to add the query number 
corresponding to the file in question in the indexed 
table 215 stored in the RAM area 216. 

30 The means for requesting the information file from 

the local cache server 200 and the means for caching the 
received information file at the central file server 230 
is a microprocessor 260, together with appropriate soft- 
ware modules, included in the Updater 240. The implemen- 

35 tation of these software modules would be well known for 
a person skilled in the art of programming. 
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An example of the operations performed by a local 
cache server 200 in the embodiment of Fig. 2 will now be 
described with reference to the flow chart in Fig 3. 

In step 300 the local cache server 200 receives a 

5 request for an Internet information file from a client- 
served by the particular local cache server. However, the 
file request may also be received from the Updater 240, 
which operates in accordance with the description 
referring to Fig. 5. The local cache server then in step 

10 301 searches its locally cached files for the file 

requested. If it finds the file, the file is transferred 
to the requesting client or to the Updater 24 0, this is 
indicated with step 302. 

If the local cache server 200 does not find the 

15 requested file during the search, i.e. it has not cached 
the requested file, it examines in step 303 if the 
request came from the Updater. If this condition is true, 
a message is returned to the Updater in step 304 indi- 
cating that the requested file is not available. If the 

20 conditional step 303 is false, i.e. if the request came 
from a client, an ICP query is sent in step 305 to the 
Feeder 210. In the next step 306, the local cache 
receives an ICP reply from the Feeder 210 indicating 
whether or not the central file server 230 has the 

25 requested file cached. In step 307 the ICP reply is 

evaluated. If the reply indicates a cache miss, i.e. the 
requested file was not centrally cached, the local cache 
server 200 makes a HTTP request far the file directed to 
the origin server of the file. If the reply on the other 

30 hand indicates a cache hit, the local cache makes a HTTP 
request to the Feeder 210 for the file, this is indicated 
with step 309. In the next step 310, the local cache 
server receives the requested file from the Feeder. 
Finally, in step 311, the file is transferred to the 

35 client which requested the file. 
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The operations performed by the Feeder 200 in the 
embodiment of Fig. 2 is now described with reference to 
the flow chart in Fig. 4. 

In step 400 the Feeder 210 receives an ICP query 
5 regarding an Internet information file from any of the" 
local cache servers 200 being handled by the Feeder. The 
query includes the URL of the queried information file. 
From this URL the Feeder 210 in step 401 derives a query 
number using an MD5 hash algorithm, which query number is 

10 used in step 4 02 when searching an indexed MD5 hash table 
being resident in the memory 216 of the Feeder 210. 

If the number is not found during the search in the 
hash table, the Feeder in step 403 sends an ICP reply 
indicating a cache miss back to the local cache server 

15 200 from which the ICP query was received. In step 404 
the Feeder 210 then orders the Updater 24 0 to retrieve 
the non-cached queried file by passing the URL of the 
queried file to the Updater. In step 405 the Feeder 210 
adds the query number corresponding to the queried file 

20 in the indexed hash table 215. This is done in response 
to that the Updater 24 0 indicates to the Feeder that the 
queried file has been transferred from the local server 
200 and stored in the central file server 230. The 
operation of the Updater 240 will be further described 

25 with reference to Fig. 5. 

If the Feeder 210 in the conditional step 4 02 finds 
the query number during the search in the hash table 215, 
it will in step 406 send an ICP reply indicating a cache 
hit back to the local cache server 200 from which the ICP 

30 query was received. In step 407 the Feeder then receives 
an HTTP request from the local cache server 200 which 
previously issued the ICP query. Similar to the ICP 
query, the HTTP request includes the URL of the requested 
information file. In step 408 the Feeder 210 retrieves 

35 the previously derived query number corresponding to the 
file. With this query number the Feeder in step 409 
queries the central file server 230 for the requested 
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information file using a standard SQL query. In step 410 
the Feeder as a response receives the cached information 
file from the central file server 230, and in the next 
step 411, the requested cached Internet information file 
is transferred from the Feeder 210 to the requesting 

local cache server 200. 

The operations performed by the Updater 240 in the 
embodiment of Fig. 2 is now described with reference to 
the flow chart in Fig. 5. 

In step 500, the Updater 240 receives an order from 
the Feeder 210 indicating that a particular file should 
be requested. The file in question was previously 
requested by the local cache server 200, but the Feeder 
found that the central cache server 230 had not cached 
the file. The order includes the URL of the file as well 
as the address of the local cache server 200 which 
requested the file from the central cache 230. The 
Updater will then, in step 501, check the requested file 
of the order against a list of known uncachable fxles. If 
the list contains the requested file, the order will be 
discarded. If the list does not contain the requested 
file, the order is put on a hold by the Updater 240 so 
that there will be time for the local cache server 200 to 
retrieve the file from its origin server. 

At a time convenient to the central file server .230, 
i.e. at a time with relative low load on the central 
server, the central server sends a message to the Updater 
240 stating that any pending order should be executed, 
the reception of this message at the Updater 240 is 
indicated with step 502. In the next step 503, the execu- 
tion of the order starts with that the Updater requests a 
copy of the file, which now should have been retrieved 
and cached locally, from the local cache server 200 from 
which the file request originated. A copy of the file is 
35 then received from the local cache server in step 504. In 
step 505, the received file copy is transferred to the 
central file server 230 to be cached by the same. In the 
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final step 506, the Updater 240 instructs the Feeder 210 
to add the query number corresponding to the file cached 
at the central file server 230 to the indexed hash table 
215. 

5 The operation of the central file server 230 is ^ 

straight forward. Basically it does two things, it 
answers SQL queries from the Feeders 210 by transferring 
cached files to them, and, it stores new information 
files in its cache, which files are transferred to it 
10 from the Updater 240. 

Another exemplifying embodiment of an Internet 
caching system according to the present invention is now 
described with reference to Fig 6. In Fig 6, the system 
differs from the one shown in Fig 2 in that the system 
15 has more than one central file server, here being exemp- 
lified with three central cache servers 630. Also, Fig. 6 
includes two Feeders 610, each of which is connected to 
its own set of local cache servers 600. The Feeders 610 
and the Updater 640 are arranged together with the 
20 central file servers 630 at a central cache site 690. By 
means of an Ethernet network 680 arranged within the 
central cache site, the Updater 640 and each Feeder 610 
are connected to all central file servers 630. 

The additional number of central file servers in 
25 this embodiment enables more files to be cached and even 
more SQL queries to be answered by the central file 
servers in comparison with the embodiment of Fig. 2. 
Since the system is completely scaleable, any number of 
Feeders, Updater s or central file servers can in theory 
30 be added to the system. 

The basic difference of the operation of the system 
in Fig. 6 to that of the system in Fig. 2 is that a 
Feeder 610 need to select one server, out of the plurali- 
ty of central file servers 630, to which an SQL query 
35 should be directed. Each central file server 630 caches 
information files within original host names within a 
predefined range. Therefore, the selection of one of the 
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central file servers is done in accordance with the host 
name included in the URL received from the local server, 
either as part of an ICP query or as part of an HTTP 
request. When one of the central file servers has been 
selected by the Feeder, the SQL query with the derived " 
query number is directed to that selected file server. 

It is understood that the construction and function 
of the elements described with reference to the drawings 
will become apparent for those skilled in the art. 

Even though the invention has been described with 
reference to specific exemplifying embodiments, many 
different alterations, modifications and the like will 
become apparent for those skilled in the art. The des- 
cribed embodiments are therefore not intended to limit 
15 the scope of the invention, as defined by the appended 
claims . 
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CLAIMS 

1. A method for serving requests for Internet 
information files in an Internet caching system, com- 
5 prising the steps of: 

receiving, at a local Internet cache server, a user 
request from a user for an Internet information file; 

in response to the received request, making a query 
for said information file, if said information file has 
10 not been cached by said local server; 

in response to a reply to said query, making a file 
request for said information file, wherein said file 
request is directed to a feeder means if said reply 
indicates that a central file server, storing cached 
15 Internet information files, has said information file 
cached; and 

querying, from said feeder means in response to said 
file request, said central file server for said informa- 
tion file, 

in order to decrease the load on said central file 
server. 

2. The method as claimed in claim 1, wherein said 
query is performed by said local cache server in accor- 
dance with a protocol used for communicating between 
Internet cache servers . 

3. The method as claimed in claim 2, wherein said 
protocol is the Internet Cache Protocol (ICP) . 

4. The method as claimed in claim 2, wherein said 
protocol is the Cache Digest. 

5. The method as claimed in any one of claims 1-3, 
wherein said query is directed by said local cache server 
to said feeder means, which feeder means as a response 
returns said reply. 



WO 00/17765 



PCT/US99/21248 



25 

6. The method as claimed in 5, comprising the step 
of deriving, at said feeder means, a query number corre- 
sponding to said information file being concerned in said 

5 query. - 

7. The method as claimed in 6, wherein said querying 
step comprises using the derived query number when 
querying said central file server for said information 

10 file. 

8. The method as claimed in claim 6, wherein said 
query provides an alphanumerical string associated with 
said information file, said string being used in said 

15 step of deriving said query number. 

9. The method as claimed in claim 8, wherein said 
alphanumerical string is a Uniform Resource Locator (URL) 
and said query number is derived from said URL and at 

20 least part of a header information field of said query. 

10. The method as claimed in any one of claims 1, 2 
or 4, wherein said file request provides an alpha- 
numerical string associated with said information file, 

25 said string being used by said feeder means for deriving 
a query number corresponding to said information file. 

11. The method as claimed in claim 10, wherein said 
alphanumerical string is a Uniform Resource Locator (URL) 

30 and said query number is derived from said URL and at 
least part of a header information field of said file 
request. 

12. The method as claimed in any one of the pre- 

35 ceding claims, comprising the step of creating an indexed 
table having an entry for each Internet information file 
being cached at said central file server. 
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13. The method as claimed in claim 12, comprising 
the steps of: 

performing a search in said indexed table for said 
. 5 information file; and 

indicating in said reply to said query whether or 
not said information file was found during said search. 

14. The method as claimed in any one of the pre- 

10 ceding claims, wherein said querying step comprises using 
the Structured Query Language (SQL) when querying said 
central file server for said information file. 

15. The method as claimed in any one of the pre- 
15 ceding claims, wherein said querying step comprises the 

steps of: 

selecting, based upon an original host name or IP- 
address of said information file, a central file server 
out of a set of central file servers, each server of said 
20 set being arranged to cache Internet information files 
with original host names or IP-addresses within a pre- 
defined range; and 

querying the selected central file server for said 
information file. 

25 

16. The method as claimed in any one of claims 6 - 
14, wherein said querying step comprises the steps of: 

selecting, based upon said query number derived for 
said information file, a central file server out of a set 
30 of central file servers, each server of said set being 

arranged to cache Internet information files with corre- 
sponding query numbers within a predefined range; and 

querying the selected central file server for said 
information file. 

35 

17. The method as claimed in any one of claims 1 - 
16, comprising the further steps o£: 
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retrieving, at said local cache server, said infor- 
mation file from its origin server if said reply to said 
query indicates that said information file is not cached 
at said central file server; 
5 caching said information file at said local cache _ 

server; and 

updating said central file server by requesting a 
copy of said information file from said local cache 
server and caching said copy in said central file server. 

10 

18. An arrangement in an Internet caching system, 
said system comprising at least one local cache server 
and at least one central file server, both of which 
servers stores cached Internet information files, which 
15 arrangement, for decreasing the load on said central file 
server, includes a Feeder communicating with said local 
cache server and with said central file server, wherein 
said Feeder includes: 

first means for receiving a request for an Internet 
20 information file from said local cache server; 

second means for deriving a query from an alpha- 
numerical string received from said local cache server; 
and 

third means for querying said central file server 
25 for said Internet information file using said query 
derived by said second means. 

19. The arrangement as claimed in claim 18, wherein 
said first means is arranged to operate in accordance 

30 with a layer three Internet protocol. 

20. The arrangement as claimed in claim 18 or 19, 
wherein said third means is arranged to use the 
Structured Query Language (SQL) when querying for said 

35 Internet information file.- 
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21. The arrangement as claimed in any one of claims 
18 - 20, wherein said alphanumerical string is included 
in said request received from said local cache server. 

22. The arrangement as claimed in claim 21, wherein 
said query is derived from said alphanumerical string and 
at least part of a header information field of said 
request received from said local cache server. 

23. The arrangement as claimed in claim 22 f wherein 
said query comprises a query number, the query number 
being derived by applying a hash algorithm to said string 
and to said part of said header information field. 

15 24 • The arrangement as claimed in any one of claims 

18-20, wherein said Feeder includes: 

fourth means for receiving a query for an Internet 
information file from said local cache server; and 

fifth means for providing said local cache server 
20 with a reply to the received query. 

25. The arrangement as claimed in claim 24, wherein 
said fourth means and said fifth means are arranged to 
operate in accordance with a protocol used for communi- 

25 eating between Internet cache servers. 

26. The arrangement as claimed in claim 25, wherein 
said protocol is the Internet Cache Protocol (ICP) . 

30 27 • The arrangement as claimed in any one of claims 

24 - 26, wherein said alphanumerical string is included 
in said query received from said local cache server* 

28. The arrangement as claimed in claim 27, wherein 
35 said queryderived by said second means is derived from 
said alphanumerical string and at least part of a header 
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information field of said query received from said local 
cache server. 

29. The arrangement as claimed in claim 28, wherein 
5 said query comprises a query number, the query number " 

being derived by applying a hash algorithm to said string 
and to said part of said header information field. 

30. The arrangement as claimed in one of claims 24 - 
10 29, wherein said Feeder includes a table with a copy of 

the full index of all Internet information files cached 
at said central file server., 

31. The arrangement as claimed in claim 30, wherein 
said reply to said received query by said fifth means is 
based on the content of said table. 

32. The arrangement as claimed in one of claims 18 - 
31, wherein said arrangement, for further decreasing the 
load on said central file server, includes an Updater 
communicating with said local cache server and with said 
central file server, wherein said Updater includes: 

requesting means for requesting a copy of an 
Internet information file stored in a local cache server; 
and 

storing means for storing the thereby received copy 
in a central file server. 

33. The arrangement as claimed in claim .32, wherein 
30 said requesting means are arranged to request a copy of 

an information file from its origin server, if a local 
cache server storing said information file resides behind 
a firewall. 

35 34. The arrangement as claimed in claim 32 or 33, 

wherein said Updater is arranged to communicate with said 
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Feeder for receiving an order to request said copy of 
said information file. 

35. The arrangement as claimed in any one of claims 
32 - 34, wherein said Updater includes a list of known " 
uncachable information files, for which files a copy 
should not be requested. 

36. The arrangement as claimed in any one of claims 
16 - 35, wherein said Feeder is implemented by a lower 
end computer and said central file server is implemented 
by a higher end computer. 

37. The arrangement as claimed in any one of claims 
15 32 - 35, wherein said Updater is implemented by a lower 

end computer and said central file server is implemented 
by a higher end computer. 

38. The arrangement as claimed in claim 37, wherein 
said Updater and at least one Feeder are implemented by a 
single lower end computer. 
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39. An Internet caching system, comprising: 
a set of local Internet cache servers, wherein each 
local cache server is arranged to receive requests from 
users for Internet information files; 

at least one central file server included in a 
central cache site and storing cached Internet informa- 
tion files; and 

feeder means interconnecting said set of local cache 
servers with said central file server, said feeder means 
including at least one Feeder, which Feeder comprises 
means for communicating with at least one local cache 
server in accordance with a protocol used for communi- 
35 eating between Internet cache servers and means for 

retrieving Internet information files from said central 
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file server using data base queries, thereby decreasing 
the load on said central file server. 

40. The system as claimed in claim 39, wherein said 
5 feeder means are included in said central cache site. - 

41. The system as claimed in claims 39 or 40, where- 
in each of said feeder means includes a plurality of 
Feeders, each of said Feeder interconnecting a subset of 

10 said set of local cache servers with said central file 
server. 

42. The Internet caching system as claimed in any 
one of claims 39 - 41, wherein said central cache site is 

15 arranged to serve a defined set of local cache servers, 
which set in turn serves a linguistically and culturally 
homogenous user community. 

43. The Internet caching system as claimed in any 
20 one of claims 39-42, wherein said protocol used is 

either the Internet Cache Protocol or the Cache Digest. 

44. The Internet caching system as claimed in any 
one of claims 39 - 43, wherein each of said Feeder 

25 includes a table with a copy of the full index of all 
information files cached at said central cache site. 

45. The" Internet caching system as claimed in any 
one of claims 39-44, wherein said central file server 

30 includes cached Internet information files having 
original host names within a predefined range. 

46. The Internet caching system as claimed in any 
one of claims 39 - 45, further comprising updater means, 

35 interconnecting said central file server with at least 

one local cache server of said set, for retrieving a copy 
of an Internet information file form its origin server or 
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from said at least one local cache server and for storing 
said copy in said central file server. 
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